{"nbformat":4,"nbformat_minor":0,"metadata":{"colab":{"name":"NLU_multi_lingual_training_sentiment_classifier_demo_stock_market.ipynb","provenance":[],"collapsed_sections":["zkufh760uvF3"]},"kernelspec":{"display_name":"Python 3","name":"python3"}},"cells":[{"cell_type":"markdown","metadata":{"id":"zkufh760uvF3"},"source":["![JohnSnowLabs](https://nlp.johnsnowlabs.com/assets/images/logo.png)\n","\n","[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/JohnSnowLabs/nlu/blob/master/examples//colab/Training/multi_lingual/binary_text_classification/NLU_multi_lingual_training_sentiment_classifier_demo_stock_market.ipynb)\n","\n","\n","# Training a Sentiment Analysis Classifier with NLU \n","## 2 Class Stock Market  Sentiment Classifier Training\n","With the [SentimentDL model](https://nlp.johnsnowlabs.com/docs/en/annotators#sentimentdl-multi-class-sentiment-analysis-annotator)  from Spark NLP you can achieve State Of the Art results on any multi class text classification problem \n","\n","This notebook showcases the following features : \n","\n","- How to train the deep learning classifier\n","- How to store a pipeline to disk\n","- How to load the pipeline from disk (Enables NLU offline mode)\n","\n","You can achieve these results or even better on this dataset with training  data  : \n","\n","<br> \n","\n","![image.png]()\n","\n","\n","You can achieve these results or even better on this dataset with test  data  : \n","\n","<br> \n","\n","![image.png]()\n"]},{"cell_type":"markdown","metadata":{"id":"dur2drhW5Rvi"},"source":["# 1. Install Java 8 and NLU"]},{"cell_type":"code","metadata":{"id":"hFGnBCHavltY","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620202089264,"user_tz":-300,"elapsed":114121,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"19e81539-28da-4236-ca10-e0c23e1253ea"},"source":["!wget https://setup.johnsnowlabs.com/nlu/colab.sh -O - | bash\n","  \n","\n","import nlu"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 08:06:15--  https://raw.githubusercontent.com/JohnSnowLabs/nlu/master/scripts/colab_setup.sh\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.108.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 1671 (1.6K) [text/plain]\n","Saving to: ‘STDOUT’\n","\n","\r-                     0%[                    ]       0  --.-KB/s               \r-                   100%[===================>]   1.63K  --.-KB/s    in 0s      \n","\n","2021-05-05 08:06:15 (33.4 MB/s) - written to stdout [1671/1671]\n","\n","Installing  NLU 3.0.0 with  PySpark 3.0.2 and Spark NLP 3.0.1 for Google Colab ...\n","\u001b[K     |████████████████████████████████| 204.8MB 72kB/s \n","\u001b[K     |████████████████████████████████| 153kB 41.2MB/s \n","\u001b[K     |████████████████████████████████| 204kB 22.8MB/s \n","\u001b[K     |████████████████████████████████| 204kB 43.6MB/s \n","\u001b[?25h  Building wheel for pyspark (setup.py) ... \u001b[?25l\u001b[?25hdone\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"f4KkTfnR5Ugg"},"source":["# 2. Download Stock Market  Sentiment dataset \n","https://www.kaggle.com/yash612/stockmarket-sentiment-dataset\n","#Context\n","\n","Gathered Stock news from Multiple twitter Handles regarding Economic news dividing into two parts : Negative and positive."]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"OrVb5ZMvvrQD","executionInfo":{"status":"ok","timestamp":1620202090504,"user_tz":-300,"elapsed":115338,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"f96cb8a6-5f89-4048-8694-546ca83c7f17"},"source":["! wget http://ckl-it.de/wp-content/uploads/2021/02/stock_data_multi_lingual.csv\n"],"execution_count":null,"outputs":[{"output_type":"stream","text":["--2021-05-05 08:08:09--  http://ckl-it.de/wp-content/uploads/2021/02/stock_data_multi_lingual.csv\n","Resolving ckl-it.de (ckl-it.de)... 217.160.0.108, 2001:8d8:100f:f000::209\n","Connecting to ckl-it.de (ckl-it.de)|217.160.0.108|:80... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 564444 (551K) [text/csv]\n","Saving to: ‘stock_data_multi_lingual.csv’\n","\n","stock_data_multi_li 100%[===================>] 551.21K   879KB/s    in 0.6s    \n","\n","2021-05-05 08:08:10 (879 KB/s) - ‘stock_data_multi_lingual.csv’ saved [564444/564444]\n","\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":419},"id":"y4xSRWIhwT28","executionInfo":{"status":"ok","timestamp":1620202091050,"user_tz":-300,"elapsed":115861,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"16e5bd58-4352-4439-f243-de1fb29c9213"},"source":["import pandas as pd\n","train_path = '/content/stock_data_multi_lingual.csv'\n","\n","train_df = pd.read_csv(train_path)\n","# the text data to use for classification should be in a column named 'text'\n","columns=['text','y']\n","train_df = train_df[columns]\n","from sklearn.model_selection import train_test_split\n","train_df, test_df = train_test_split(train_df, test_size=0.2)\n","train_df"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>text</th>\n","      <th>y</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>5571</th>\n","      <td>Rupee Edges Higher To 75.51 Against Dollar\\nht...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>3475</th>\n","      <td>AAP Is Still Cool</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>4429</th>\n","      <td>user: AKAM insiders buying heavily  these leve...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>4681</th>\n","      <td>well no complaints at this point regarding the...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>2582</th>\n","      <td>SGY broke down its 50EMA &amp; trendline support o...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>5704</th>\n","      <td>Gold Futures Drop Over 2% To Rs 39,354 Per 10 ...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>2191</th>\n","      <td>SQNM a Continuation - wil take it over the top...</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>1980</th>\n","      <td>BAC ot of buying on last minute !!!</td>\n","      <td>positive</td>\n","    </tr>\n","    <tr>\n","      <th>1582</th>\n","      <td>Jeff Bezo's the wizard...it's all about Gross ...</td>\n","      <td>negative</td>\n","    </tr>\n","    <tr>\n","      <th>988</th>\n","      <td>BAC anyone think this might slush and fall bel...</td>\n","      <td>negative</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>4632 rows × 2 columns</p>\n","</div>"],"text/plain":["                                                   text         y\n","5571  Rupee Edges Higher To 75.51 Against Dollar\\nht...  negative\n","3475                                AAP Is Still Cool    positive\n","4429  user: AKAM insiders buying heavily  these leve...  positive\n","4681  well no complaints at this point regarding the...  positive\n","2582  SGY broke down its 50EMA & trendline support o...  negative\n","...                                                 ...       ...\n","5704  Gold Futures Drop Over 2% To Rs 39,354 Per 10 ...  negative\n","2191  SQNM a Continuation - wil take it over the top...  positive\n","1980                BAC ot of buying on last minute !!!  positive\n","1582  Jeff Bezo's the wizard...it's all about Gross ...  negative\n","988   BAC anyone think this might slush and fall bel...  negative\n","\n","[4632 rows x 2 columns]"]},"metadata":{"tags":[]},"execution_count":3}]},{"cell_type":"markdown","metadata":{"id":"0296Om2C5anY"},"source":["# 3. Train Deep Learning Classifier using nlu.load('train.sentiment')\n","\n","You dataset label column should be named 'y' and the feature column with text data should be named 'text'"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":861},"id":"3ZIPkRkWftBG","executionInfo":{"status":"ok","timestamp":1620204658116,"user_tz":-300,"elapsed":2682905,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"47789158-bb85-4078-9ca2-64d4455b020c"},"source":["trainable_pipe = nlu.load('xx.embed_sentence.labse train.sentiment')\n","# We need to train longer and user smaller LR for NON-USE based sentence embeddings usually\n","# We could tune the hyperparameters further with hyperparameter tuning methods like gridsearch\n","# Also longer training gives more accuracy\n","trainable_pipe['trainable_sentiment_dl'].setMaxEpochs(60)  \n","trainable_pipe['trainable_sentiment_dl'].setLr(0.005) \n","fitted_pipe = trainable_pipe.fit(train_df)\n","# predict with the trainable pipeline on dataset and get predictions\n","preds = fitted_pipe.predict(train_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","from sklearn.metrics import classification_report\n","print(classification_report(preds['y'], preds['sentiment']))\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["labse download started this may take some time.\n","Approximate size to download 1.7 GB\n","[OK!]\n","sentence_detector_dl download started this may take some time.\n","Approximate size to download 354.6 KB\n","[OK!]\n","              precision    recall  f1-score   support\n","\n","    negative       0.92      0.82      0.87      1672\n","     neutral       0.00      0.00      0.00         0\n","    positive       0.91      0.96      0.93      2960\n","\n","    accuracy                           0.91      4632\n","   macro avg       0.61      0.59      0.60      4632\n","weighted avg       0.91      0.91      0.91      4632\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>y</th>\n","      <th>text</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Rupee Edges Higher To 75.51 Against Dollar ht...</td>\n","      <td>5571</td>\n","      <td>negative</td>\n","      <td>Rupee Edges Higher To 75.51 Against Dollar\\nht...</td>\n","      <td>1.000000</td>\n","      <td>negative</td>\n","      <td>[-0.03053501807153225, 0.042389560490846634, -...</td>\n","      <td>Rupee Edges Higher To 75.51 Against Dollar htt...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>[AAP Is Still Cool]</td>\n","      <td>3475</td>\n","      <td>positive</td>\n","      <td>AAP Is Still Cool</td>\n","      <td>0.999996</td>\n","      <td>positive</td>\n","      <td>[-0.034850019961595535, -0.044849760830402374,...</td>\n","      <td>AAP Is Still Cool</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>[user:,  AKAM insiders buying heavily these le...</td>\n","      <td>4429</td>\n","      <td>positive</td>\n","      <td>user: AKAM insiders buying heavily  these leve...</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[0.006040376145392656, -0.014217519201338291, ...</td>\n","      <td>user: AKAM insiders buying heavily these levels</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>[well no complaints at this point regarding th...</td>\n","      <td>4681</td>\n","      <td>positive</td>\n","      <td>well no complaints at this point regarding the...</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.02124304696917534, -0.01161095593124628, -...</td>\n","      <td>well no complaints at this point regarding the...</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>[SGY broke down its 50EMA &amp; trendline support ...</td>\n","      <td>2582</td>\n","      <td>negative</td>\n","      <td>SGY broke down its 50EMA &amp; trendline support o...</td>\n","      <td>0.999996</td>\n","      <td>negative</td>\n","      <td>[-0.0251691285520792, 0.05739616975188255, -0....</td>\n","      <td>SGY broke down its 50EMA &amp; trendline support o...</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>4627</th>\n","      <td>[Gold Futures Drop Over 2% To Rs 39,354 Per 10...</td>\n","      <td>5704</td>\n","      <td>negative</td>\n","      <td>Gold Futures Drop Over 2% To Rs 39,354 Per 10 ...</td>\n","      <td>0.999668</td>\n","      <td>negative</td>\n","      <td>[-0.05454382300376892, -0.007509403396397829, ...</td>\n","      <td>Gold Futures Drop Over 2% To Rs 39,354 Per 10 ...</td>\n","    </tr>\n","    <tr>\n","      <th>4628</th>\n","      <td>[SQNM a Continuation - wil take it over the to...</td>\n","      <td>2191</td>\n","      <td>positive</td>\n","      <td>SQNM a Continuation - wil take it over the top...</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[0.04926764965057373, 0.04899105057120323, 0.0...</td>\n","      <td>SQNM a Continuation - wil take it over the top...</td>\n","    </tr>\n","    <tr>\n","      <th>4629</th>\n","      <td>[BAC ot of buying on last minute !, !!]</td>\n","      <td>1980</td>\n","      <td>positive</td>\n","      <td>BAC ot of buying on last minute !!!</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.02965172566473484, -0.02375778928399086, 0...</td>\n","      <td>BAC ot of buying on last minute !!!</td>\n","    </tr>\n","    <tr>\n","      <th>4630</th>\n","      <td>[Jeff Bezo's the wizard., ..it's all about Gro...</td>\n","      <td>1582</td>\n","      <td>negative</td>\n","      <td>Jeff Bezo's the wizard...it's all about Gross ...</td>\n","      <td>0.999998</td>\n","      <td>negative</td>\n","      <td>[-0.04103326052427292, -0.013734265230596066, ...</td>\n","      <td>Jeff Bezo's the wizard...it's all about Gross ...</td>\n","    </tr>\n","    <tr>\n","      <th>4631</th>\n","      <td>[BAC anyone think this might slush and fall be...</td>\n","      <td>988</td>\n","      <td>negative</td>\n","      <td>BAC anyone think this might slush and fall bel...</td>\n","      <td>0.999999</td>\n","      <td>negative</td>\n","      <td>[-0.05278955399990082, 0.015668092295527458, 0...</td>\n","      <td>BAC anyone think this might slush and fall bel...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>4632 rows × 8 columns</p>\n","</div>"],"text/plain":["                                               sentence  ...                                           document\n","0     [Rupee Edges Higher To 75.51 Against Dollar ht...  ...  Rupee Edges Higher To 75.51 Against Dollar htt...\n","1                                   [AAP Is Still Cool]  ...                                  AAP Is Still Cool\n","2     [user:,  AKAM insiders buying heavily these le...  ...    user: AKAM insiders buying heavily these levels\n","3     [well no complaints at this point regarding th...  ...  well no complaints at this point regarding the...\n","4     [SGY broke down its 50EMA & trendline support ...  ...  SGY broke down its 50EMA & trendline support o...\n","...                                                 ...  ...                                                ...\n","4627  [Gold Futures Drop Over 2% To Rs 39,354 Per 10...  ...  Gold Futures Drop Over 2% To Rs 39,354 Per 10 ...\n","4628  [SQNM a Continuation - wil take it over the to...  ...  SQNM a Continuation - wil take it over the top...\n","4629            [BAC ot of buying on last minute !, !!]  ...                BAC ot of buying on last minute !!!\n","4630  [Jeff Bezo's the wizard., ..it's all about Gro...  ...  Jeff Bezo's the wizard...it's all about Gross ...\n","4631  [BAC anyone think this might slush and fall be...  ...  BAC anyone think this might slush and fall bel...\n","\n","[4632 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":4}]},{"cell_type":"markdown","metadata":{"id":"_1jxw3GnVGlI"},"source":["# 3.1 evaluate on Test Data"]},{"cell_type":"code","metadata":{"id":"Fxx4yNkNVGFl","colab":{"base_uri":"https://localhost:8080/"},"executionInfo":{"status":"ok","timestamp":1620204828990,"user_tz":-300,"elapsed":2853766,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"6cd168da-21da-485d-bbe0-8929ae5b33a4"},"source":["preds = fitted_pipe.predict(test_df,output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['sentiment']))\n"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","    negative       0.72      0.59      0.65       434\n","     neutral       0.00      0.00      0.00         0\n","    positive       0.78      0.85      0.81       725\n","\n","    accuracy                           0.75      1159\n","   macro avg       0.50      0.48      0.49      1159\n","weighted avg       0.76      0.75      0.75      1159\n","\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"BD5OKO4Umc5U"},"source":["# 4. Test Model  on 20 languages!"]},{"cell_type":"code","metadata":{"id":"OQ72hP9unML7","colab":{"base_uri":"https://localhost:8080/","height":759},"executionInfo":{"status":"ok","timestamp":1620204845711,"user_tz":-300,"elapsed":2870481,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"3ce6fc97-2617-4a4b-84b0-f694bb704a3c"},"source":["train_df = pd.read_csv(\"/content/stock_data_multi_lingual.csv\")\n","preds = fitted_pipe.predict(train_df[[\"test_sentences\",\"y\"]].iloc[:100],output_level='document')\n","\n","#sentence detector that is part of the pipe generates sone NaNs. lets drop them first\n","preds.dropna(inplace=True)\n","print(classification_report(preds['y'], preds['sentiment']))\n","\n","\n","preds"],"execution_count":null,"outputs":[{"output_type":"stream","text":["              precision    recall  f1-score   support\n","\n","    negative       0.35      0.62      0.44        13\n","     neutral       0.00      0.00      0.00         0\n","    positive       0.95      0.80      0.87        87\n","\n","    accuracy                           0.78       100\n","   macro avg       0.43      0.47      0.44       100\n","weighted avg       0.87      0.78      0.81       100\n","\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>y</th>\n","      <th>text</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[İzləmə siyahımdakı Kickers XIDE TIT SOQ PNK C...</td>\n","      <td>0</td>\n","      <td>positive</td>\n","      <td>İzləmə siyahımdakı Kickers XIDE TIT SOQ PNK CP...</td>\n","      <td>0.586977</td>\n","      <td>neutral</td>\n","      <td>[-0.0005844525876455009, 0.012249358929693699,...</td>\n","      <td>İzləmə siyahımdakı Kickers XIDE TIT SOQ PNK CP...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>[उपयोगकर्ता: AAP MOVIE। वर्ष के लिए FEA / GEED...</td>\n","      <td>1</td>\n","      <td>positive</td>\n","      <td>उपयोगकर्ता: AAP MOVIE। वर्ष के लिए FEA / GEED ...</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.027744855731725693, -0.034640125930309296,...</td>\n","      <td>उपयोगकर्ता: AAP MOVIE। वर्ष के लिए FEA / GEED ...</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>[משתמש אני מפחד לקצר את AMZN - הם נראים כמו מו...</td>\n","      <td>2</td>\n","      <td>positive</td>\n","      <td>משתמש אני מפחד לקצר את AMZN - הם נראים כמו מונ...</td>\n","      <td>0.999755</td>\n","      <td>negative</td>\n","      <td>[-0.029554689303040504, -0.0026017462369054556...</td>\n","      <td>משתמש אני מפחד לקצר את AMZN - הם נראים כמו מונ...</td>\n","    </tr>\n","    <tr>\n","      <th>3</th>\n","      <td>[12.00 से अधिक MNTA]</td>\n","      <td>3</td>\n","      <td>positive</td>\n","      <td>12.00 से अधिक MNTA</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.03708072751760483, 0.054913319647312164, 0...</td>\n","      <td>12.00 से अधिक MNTA</td>\n","    </tr>\n","    <tr>\n","      <th>4</th>\n","      <td>[OI 21.37ден жогору]</td>\n","      <td>4</td>\n","      <td>positive</td>\n","      <td>OI 21.37ден жогору</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.043793801218271255, 0.03190923109650612, -...</td>\n","      <td>OI 21.37ден жогору</td>\n","    </tr>\n","    <tr>\n","      <th>...</th>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","      <td>...</td>\n","    </tr>\n","    <tr>\n","      <th>95</th>\n","      <td>[NG nhod - kyk na die weeklikse - teiken vorig...</td>\n","      <td>95</td>\n","      <td>positive</td>\n","      <td>NG nhod - kyk na die weeklikse - teiken vorige...</td>\n","      <td>0.999998</td>\n","      <td>positive</td>\n","      <td>[-0.03982162103056908, -0.07269033044576645, -...</td>\n","      <td>NG nhod - kyk na die weeklikse - teiken vorige...</td>\n","    </tr>\n","    <tr>\n","      <th>96</th>\n","      <td>[NG nhod - ¿qué ves? consulte el semanario - o...</td>\n","      <td>96</td>\n","      <td>positive</td>\n","      <td>NG nhod - ¿qué ves? consulte el semanario - ob...</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.04516294226050377, -0.04459897428750992, 0...</td>\n","      <td>NG nhod - ¿qué ves? consulte el semanario - ob...</td>\n","    </tr>\n","    <tr>\n","      <th>97</th>\n","      <td>[এআইজি আমেরিকান ইন্টারন্যাশনাল গ্রুপ অপশন ট্রে...</td>\n","      <td>97</td>\n","      <td>negative</td>\n","      <td>এআইজি আমেরিকান ইন্টারন্যাশনাল গ্রুপ অপশন ট্রেড...</td>\n","      <td>0.932880</td>\n","      <td>negative</td>\n","      <td>[-0.0716203823685646, -0.00996206421405077, -0...</td>\n","      <td>এআইজি আমেরিকান ইন্টারন্যাশনাল গ্রুপ অপশন ট্রেড...</td>\n","    </tr>\n","    <tr>\n","      <th>98</th>\n","      <td>[P out balance +.32]</td>\n","      <td>98</td>\n","      <td>positive</td>\n","      <td>P out balance +.32</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.0412631593644619, -0.0414082333445549, -0....</td>\n","      <td>P out balance +.32</td>\n","    </tr>\n","    <tr>\n","      <th>99</th>\n","      <td>[VNG ซื้อเทียบกับขาย?]</td>\n","      <td>99</td>\n","      <td>positive</td>\n","      <td>VNG ซื้อเทียบกับขาย?</td>\n","      <td>1.000000</td>\n","      <td>positive</td>\n","      <td>[-0.038816627115011215, 0.04581355303525925, -...</td>\n","      <td>VNG ซื้อเทียบกับขาย?</td>\n","    </tr>\n","  </tbody>\n","</table>\n","<p>100 rows × 8 columns</p>\n","</div>"],"text/plain":["                                             sentence  ...                                           document\n","0   [İzləmə siyahımdakı Kickers XIDE TIT SOQ PNK C...  ...  İzləmə siyahımdakı Kickers XIDE TIT SOQ PNK CP...\n","1   [उपयोगकर्ता: AAP MOVIE। वर्ष के लिए FEA / GEED...  ...  उपयोगकर्ता: AAP MOVIE। वर्ष के लिए FEA / GEED ...\n","2   [משתמש אני מפחד לקצר את AMZN - הם נראים כמו מו...  ...  משתמש אני מפחד לקצר את AMZN - הם נראים כמו מונ...\n","3                                [12.00 से अधिक MNTA]  ...                                 12.00 से अधिक MNTA\n","4                                [OI 21.37ден жогору]  ...                                 OI 21.37ден жогору\n","..                                                ...  ...                                                ...\n","95  [NG nhod - kyk na die weeklikse - teiken vorig...  ...  NG nhod - kyk na die weeklikse - teiken vorige...\n","96  [NG nhod - ¿qué ves? consulte el semanario - o...  ...  NG nhod - ¿qué ves? consulte el semanario - ob...\n","97  [এআইজি আমেরিকান ইন্টারন্যাশনাল গ্রুপ অপশন ট্রে...  ...  এআইজি আমেরিকান ইন্টারন্যাশনাল গ্রুপ অপশন ট্রেড...\n","98                               [P out balance +.32]  ...                                 P out balance +.32\n","99                             [VNG ซื้อเทียบกับขาย?]  ...                               VNG ซื้อเทียบกับขาย?\n","\n","[100 rows x 8 columns]"]},"metadata":{"tags":[]},"execution_count":6}]},{"cell_type":"markdown","metadata":{"id":"RjtuNUcvuJTT"},"source":["# The Model understands Englsih\n","![en](https://www.worldometers.info/img/flags/small/tn_nz-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"o0vu7PaWkcI7","executionInfo":{"status":"ok","timestamp":1620204846415,"user_tz":-300,"elapsed":2871176,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"7b6b47f7-39bf-4af7-f5a5-c6c592d3fd5e"},"source":["fitted_pipe.predict(\"Bitcoin dropped by 50 percent !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin dropped by 50 percent !, !!]</td>\n","      <td>0</td>\n","      <td>0.999995</td>\n","      <td>negative</td>\n","      <td>[-0.05163608863949776, -0.029772670939564705, ...</td>\n","      <td>Bitcoin dropped by 50 percent !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                sentence  ...                           document\n","0  [Bitcoin dropped by 50 percent !, !!]  ...  Bitcoin dropped by 50 percent !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":7}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"1ykjRQhCtQ4w","executionInfo":{"status":"ok","timestamp":1620204847415,"user_tz":-300,"elapsed":2872169,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"fb8e35dd-2dcb-4d68-fb92-213fc1bde95d"},"source":["fitted_pipe.predict(\"Bitcoin went up  by 50 percent !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin went up by 50 percent !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.028688747435808182, -0.026630541309714317,...</td>\n","      <td>Bitcoin went up by 50 percent !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                sentence  ...                           document\n","0  [Bitcoin went up by 50 percent !, !!]  ...  Bitcoin went up by 50 percent !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":8}]},{"cell_type":"markdown","metadata":{"id":"vohym-XbuNHn"},"source":["# The Model understands German\n","![de](https://www.worldometers.info/img/flags/small/tn_gm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"dzaaZrI4tVWc","executionInfo":{"status":"ok","timestamp":1620204848517,"user_tz":-300,"elapsed":2873266,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"884204ac-af7c-41ad-caba-6cc4ab0daa78"},"source":["# German for:'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin stieg um 50 Prozent auf !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin stieg um 50 Prozent auf !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.038156550377607346, -0.024729670956730843,...</td>\n","      <td>Bitcoin stieg um 50 Prozent auf !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                sentence  ...                             document\n","0  [Bitcoin stieg um 50 Prozent auf !!!]  ...  Bitcoin stieg um 50 Prozent auf !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":9}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"BbhgTSBGtTtJ","executionInfo":{"status":"ok","timestamp":1620204849519,"user_tz":-300,"elapsed":2874263,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"6ea6ee4f-27d7-4282-99cb-b68207577558"},"source":["# German for: 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin fiel um 50 Prozent !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin fiel um 50 Prozent !, !!]</td>\n","      <td>0</td>\n","      <td>0.999989</td>\n","      <td>negative</td>\n","      <td>[-0.05688922852277756, -0.02544567361474037, -...</td>\n","      <td>Bitcoin fiel um 50 Prozent !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                             sentence  ...                        document\n","0  [Bitcoin fiel um 50 Prozent !, !!]  ...  Bitcoin fiel um 50 Prozent !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":10}]},{"cell_type":"markdown","metadata":{"id":"a1JbtmWquQwj"},"source":["# The Model understands Chinese\n","![zh](https://www.worldometers.info/img/flags/small/tn_ch-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"kYSYqtoRtc-P","executionInfo":{"status":"ok","timestamp":1620204850369,"user_tz":-300,"elapsed":2875107,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"bc3edc3e-4295-462b-83b5-4850d5d8a751"},"source":["# Chinese for: \"Bitcoin dropped by 50 percent !!!\"\n","fitted_pipe.predict(\"比特币下跌了50％!!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[比特币下跌了50％!, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>negative</td>\n","      <td>[-0.07537588477134705, -0.027679994702339172, ...</td>\n","      <td>比特币下跌了50％!!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["           sentence  ...      document\n","0  [比特币下跌了50％!, !!]  ...  比特币下跌了50％!!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":11}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"06v9SD-QtlBU","executionInfo":{"status":"ok","timestamp":1620204851535,"user_tz":-300,"elapsed":2876267,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"636b4438-8a71-4ba2-b6e3-25490282c4e2"},"source":["# Chinese for : \"Bitcoin went up by 50 percent !!!\"\n","fitted_pipe.predict(\"比特币上涨了50％！\")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[比特币上涨了50％！]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.04113336279988289, -0.00941209401935339, -...</td>\n","      <td>比特币上涨了50％！</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["       sentence  ...    document\n","0  [比特币上涨了50％！]  ...  比特币上涨了50％！\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":12}]},{"cell_type":"markdown","metadata":{"id":"9h7CvN4uu9Pb"},"source":["# Model understands Afrikaans\n","\n","![af](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)\n","\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"VMPhbgw9twtf","executionInfo":{"status":"ok","timestamp":1620204851985,"user_tz":-300,"elapsed":2876712,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"a14811bb-3acc-4264-9c5c-5cf561721d29"},"source":["# Afrikaans for 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin het met 50 persent toegeneem !!!\")\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin het met 50 persent toegeneem !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.03586146607995033, -0.03901935741305351, -...</td>\n","      <td>Bitcoin het met 50 persent toegeneem !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                       sentence  ...                                  document\n","0  [Bitcoin het met 50 persent toegeneem !, !!]  ...  Bitcoin het met 50 persent toegeneem !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":13}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"zWgNTIdkumhX","executionInfo":{"status":"ok","timestamp":1620204853421,"user_tz":-300,"elapsed":2878142,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b5a7dccc-8e18-40f3-b772-b328093fe6ec"},"source":["# Afrikaans for :'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin het met 50 persent gedaal !!! |')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin het met 50 persent gedaal !!! |]</td>\n","      <td>0</td>\n","      <td>0.930014</td>\n","      <td>negative</td>\n","      <td>[-0.05142543464899063, -0.03921075910329819, -...</td>\n","      <td>Bitcoin het met 50 persent gedaal !!! |</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                    sentence  ...                                 document\n","0  [Bitcoin het met 50 persent gedaal !!! |]  ...  Bitcoin het met 50 persent gedaal !!! |\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":14}]},{"cell_type":"markdown","metadata":{"id":"rSEPkC-Bwnpg"},"source":["# The model understands Vietnamese\n","![vi](https://www.worldometers.info/img/flags/small/tn_vm-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"wCcTS5gIu511","executionInfo":{"status":"ok","timestamp":1620204853991,"user_tz":-300,"elapsed":2878701,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"dd406ee5-9431-4151-cb25-eea4a7cb5967"},"source":["# Vietnamese for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin đã tăng 50% !!! ')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin đã tăng 50% !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.035115890204906464, -0.053469520062208176,...</td>\n","      <td>Bitcoin đã tăng 50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                      sentence  ...                 document\n","0  [Bitcoin đã tăng 50% !, !!]  ...  Bitcoin đã tăng 50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":15}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"3Y-kLeGp5uc0","executionInfo":{"status":"ok","timestamp":1620204854787,"user_tz":-300,"elapsed":2879490,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"d8d97343-2368-4e50-9f87-754ad79eff72"},"source":["# Vietnamese for : 'Bitcoin droppedy by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin giảm 50% !!! ')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin giảm 50% !, !!]</td>\n","      <td>0</td>\n","      <td>0.912477</td>\n","      <td>positive</td>\n","      <td>[-0.013879671692848206, -0.05431622639298439, ...</td>\n","      <td>Bitcoin giảm 50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                   sentence  ...              document\n","0  [Bitcoin giảm 50% !, !!]  ...  Bitcoin giảm 50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":16}]},{"cell_type":"markdown","metadata":{"id":"IlkmAaMoxTuy"},"source":["# The model understands Japanese\n","![ja](https://www.worldometers.info/img/flags/small/tn_ja-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"1IfJu3q8wwUt","executionInfo":{"status":"ok","timestamp":1620204855820,"user_tz":-300,"elapsed":2880518,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c71a8ddd-26df-4b28-9b94-d79285aca4d0"},"source":["\n","# Japanese for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('ビットコインは50％上昇しました!!! ')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[ビットコインは50％上昇しました!!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.04407081380486488, -0.013696372509002686, ...</td>\n","      <td>ビットコインは50％上昇しました!!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                sentence  ...             document\n","0  [ビットコインは50％上昇しました!!!]  ...  ビットコインは50％上昇しました!!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":17}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"h3k7_PFhxOve","executionInfo":{"status":"ok","timestamp":1620204856723,"user_tz":-300,"elapsed":2881415,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"4420c8bc-01aa-4bb7-bfc5-4218478f828d"},"source":["\n","# Japanese for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoinは50％減少しました!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoinは50％減少しました!]</td>\n","      <td>0</td>\n","      <td>0.999988</td>\n","      <td>negative</td>\n","      <td>[-0.05689822509884834, -0.04127806797623634, -...</td>\n","      <td>Bitcoinは50％減少しました!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["               sentence  ...            document\n","0  [Bitcoinは50％減少しました!]  ...  Bitcoinは50％減少しました!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":18}]},{"cell_type":"markdown","metadata":{"id":"GITfT7FK0CGv"},"source":["# The model understands Zulu\n","![zu](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"6uelDwq4xdWv","executionInfo":{"status":"ok","timestamp":1620204857545,"user_tz":-300,"elapsed":2882230,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"8a968f5d-0e42-4c26-8981-28b8edcd7198"},"source":["# Zulu for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('I-Bitcoin inyuke ngamaphesenti ama-50 !!!')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[I-Bitcoin inyuke ngamaphesenti ama-50 !!!]</td>\n","      <td>0</td>\n","      <td>0.999993</td>\n","      <td>positive</td>\n","      <td>[-0.04226835444569588, -0.029177606105804443, ...</td>\n","      <td>I-Bitcoin inyuke ngamaphesenti ama-50 !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                      sentence  ...                                   document\n","0  [I-Bitcoin inyuke ngamaphesenti ama-50 !!!]  ...  I-Bitcoin inyuke ngamaphesenti ama-50 !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":19}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"NY_D-USEBeFe","executionInfo":{"status":"ok","timestamp":1620204858547,"user_tz":-300,"elapsed":2883226,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"83f5b821-fc09-43cd-a2e2-e9df34b78352"},"source":["# Zulu for : 'The whole crypto system crashed!!! '\n","fitted_pipe.predict('Lonke uhlelo lwe-crypto luphahlazeka !!!')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Lonke uhlelo lwe-crypto luphahlazeka !, !!]</td>\n","      <td>0</td>\n","      <td>0.994109</td>\n","      <td>negative</td>\n","      <td>[0.014095810241997242, -0.0629298985004425, -0...</td>\n","      <td>Lonke uhlelo lwe-crypto luphahlazeka !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                       sentence  ...                                  document\n","0  [Lonke uhlelo lwe-crypto luphahlazeka !, !!]  ...  Lonke uhlelo lwe-crypto luphahlazeka !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":20}]},{"cell_type":"markdown","metadata":{"id":"VGVvzl_30a0T"},"source":["# The  Model understands Turkish\n","![tr](https://www.worldometers.info/img/flags/small/tn_tu-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"DRNnuEeQz2pd","executionInfo":{"status":"ok","timestamp":1620204859432,"user_tz":-300,"elapsed":2884106,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"539d80f1-61e1-4d26-b411-0a5319d5869e"},"source":["# Turkish for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin yüzde 50 düştü !!! ')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin yüzde 50 düştü !, !, !]</td>\n","      <td>0</td>\n","      <td>0.984235</td>\n","      <td>positive</td>\n","      <td>[-0.02441188506782055, -0.04112468659877777, -...</td>\n","      <td>Bitcoin yüzde 50 düştü !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                           sentence  ...                    document\n","0  [Bitcoin yüzde 50 düştü !, !, !]  ...  Bitcoin yüzde 50 düştü !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":21}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"aOSsiK6J0jWs","executionInfo":{"status":"ok","timestamp":1620204859976,"user_tz":-300,"elapsed":2884642,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"a7982174-5286-494c-b5a0-89095facf623"},"source":["# Turkish for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin yüzde 50 arttı !!!')\n","\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin yüzde 50 arttı !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.02950628288090229, -0.022814499214291573, ...</td>\n","      <td>Bitcoin yüzde 50 arttı !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                         sentence  ...                    document\n","0  [Bitcoin yüzde 50 arttı !, !!]  ...  Bitcoin yüzde 50 arttı !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":22}]},{"cell_type":"markdown","metadata":{"id":"803qL2gt0vlb"},"source":["#  The Model understands Hebrew\n","![he](https://www.worldometers.info/img/flags/small/tn_sf-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"XQ5VCtxw0pc0","executionInfo":{"status":"ok","timestamp":1620204861244,"user_tz":-300,"elapsed":2885906,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"529a0ee9-19b3-4e86-a5fc-695941b6e13f"},"source":["# Hebrew for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin ירד ב -50% !!! ')\n","\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin ירד ב -50% !, !!]</td>\n","      <td>0</td>\n","      <td>0.999994</td>\n","      <td>negative</td>\n","      <td>[-0.058318834751844406, -0.04578540101647377, ...</td>\n","      <td>Bitcoin ירד ב -50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                     sentence  ...                document\n","0  [Bitcoin ירד ב -50% !, !!]  ...  Bitcoin ירד ב -50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":23}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"9w2ZHfns05A4","executionInfo":{"status":"ok","timestamp":1620204861767,"user_tz":-300,"elapsed":2886424,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"c539033f-24a3-4e34-c127-d137658f1315"},"source":["# Hebrew for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin עלה ב -50% !!! ')\n"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin עלה ב -50% !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.03875327855348587, -0.04096429422497749, -...</td>\n","      <td>Bitcoin עלה ב -50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                     sentence  ...                document\n","0  [Bitcoin עלה ב -50% !, !!]  ...  Bitcoin עלה ב -50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":24}]},{"cell_type":"markdown","metadata":{"id":"SDlpd33H1HIX"},"source":["# The Model understands Telugu\n","![te](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Kc5n1bzv1BJT","executionInfo":{"status":"ok","timestamp":1620204862983,"user_tz":-300,"elapsed":2887633,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"1cbcaf6e-dbda-48d9-d58a-3bf888b4bcac"},"source":["# Telugu for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('బిట్\\u200cకాయిన్ 50 శాతం పెరిగింది !!!' )"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[బిట్‌కాయిన్ 50 శాతం పెరిగింది !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.04653506726026535, 0.020184172317385674, -...</td>\n","      <td>బిట్‌కాయిన్ 50 శాతం పెరిగింది !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                              sentence  ...                           document\n","0  [బిట్‌కాయిన్ 50 శాతం పెరిగింది !!!]  ...  బిట్‌కాయిన్ 50 శాతం పెరిగింది !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":25}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"-l-u6vrz1Obe","executionInfo":{"status":"ok","timestamp":1620204863397,"user_tz":-300,"elapsed":2888040,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"0c8c1acf-3752-43c2-b9bb-53ed598b9d0d"},"source":["# Telgu for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('బిట్\\u200cకాయిన్ 50 శాతం పడిపోయింది !!! ')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[బిట్‌కాయిన్ 50 శాతం పడిపోయింది !!!]</td>\n","      <td>0</td>\n","      <td>0.999995</td>\n","      <td>negative</td>\n","      <td>[-0.07144764810800552, 0.00431971438229084, -0...</td>\n","      <td>బిట్‌కాయిన్ 50 శాతం పడిపోయింది !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                               sentence  ...                            document\n","0  [బిట్‌కాయిన్ 50 శాతం పడిపోయింది !!!]  ...  బిట్‌కాయిన్ 50 శాతం పడిపోయింది !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":26}]},{"cell_type":"markdown","metadata":{"id":"nziBUe8t1Zwn"},"source":["# Model understands Russian\n","![ru](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Ckyjl3YQ1VFn","executionInfo":{"status":"ok","timestamp":1620204863722,"user_tz":-300,"elapsed":2888355,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"5a33f302-995c-4357-f80f-c3adec65f23b"},"source":["# Russian for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Биткойн упал на 50 процентов !!! ')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Биткойн упал на 50 процентов !!!]</td>\n","      <td>0</td>\n","      <td>0.999988</td>\n","      <td>negative</td>\n","      <td>[-0.05514693260192871, -0.025273755192756653, ...</td>\n","      <td>Биткойн упал на 50 процентов !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                             sentence  ...                          document\n","0  [Биткойн упал на 50 процентов !!!]  ...  Биткойн упал на 50 процентов !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":27}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"GIdWkfGv1gFz","executionInfo":{"status":"ok","timestamp":1620204864709,"user_tz":-300,"elapsed":2889336,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"04798c4e-1524-4219-a424-d8a6aef7ca2a"},"source":["# Russian for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('Биткойн поднялся на 50 процентов !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Биткойн поднялся на 50 процентов !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.0347013957798481, -0.01663934625685215, -0...</td>\n","      <td>Биткойн поднялся на 50 процентов !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                 sentence  ...                              document\n","0  [Биткойн поднялся на 50 процентов !!!]  ...  Биткойн поднялся на 50 процентов !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":28}]},{"cell_type":"markdown","metadata":{"id":"8R1j9mwz2Cm4"},"source":["# Model understands Urdu\n","![ur](https://www.worldometers.info/img/flags/small/tn_pk-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"j4zwvRV11pcG","executionInfo":{"status":"ok","timestamp":1620204865516,"user_tz":-300,"elapsed":2890134,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b5809ecd-d35e-40c9-c5a9-38b707db8a04"},"source":["# Urdu for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin 50 فیصد کی طرف سے گرا دیا !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin 50 فیصد کی طرف سے گرا دیا !!!]</td>\n","      <td>0</td>\n","      <td>0.999564</td>\n","      <td>negative</td>\n","      <td>[-0.042979832738637924, -0.042187534272670746,...</td>\n","      <td>Bitcoin 50 فیصد کی طرف سے گرا دیا !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                  sentence  ...                               document\n","0  [Bitcoin 50 فیصد کی طرف سے گرا دیا !!!]  ...  Bitcoin 50 فیصد کی طرف سے گرا دیا !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":29}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"_EwpYn_hBpzt","executionInfo":{"status":"ok","timestamp":1620204865962,"user_tz":-300,"elapsed":2890572,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"4e79bc75-5aa6-4f31-b0c6-8e23caa7a92d"},"source":["# Urdu for : 'TDollar rates skyrocketed!!'\n","fitted_pipe.predict('ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!!]</td>\n","      <td>0</td>\n","      <td>0.615615</td>\n","      <td>positive</td>\n","      <td>[-0.06762911379337311, -0.02299044094979763, -...</td>\n","      <td>ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                 sentence  ...                              document\n","0  [ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!!]  ...  ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":30}]},{"cell_type":"markdown","metadata":{"id":"RoNg-C3k1qcX"},"source":["# Model understands Hindi\n","![hi](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)\n"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"QZ9RT5Wv1r1n","executionInfo":{"status":"ok","timestamp":1620204867391,"user_tz":-300,"elapsed":2891993,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"f189db28-78b8-4860-9aff-c5c463d3683f"},"source":["# Hindi for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('बिटकॉइन 50 प्रतिशत चढ़ गया !!! ')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[बिटकॉइन 50 प्रतिशत चढ़ गया !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.03370286896824837, -0.027637438848614693, ...</td>\n","      <td>बिटकॉइन 50 प्रतिशत चढ़ गया !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                           sentence  ...                        document\n","0  [बिटकॉइन 50 प्रतिशत चढ़ गया !!!]  ...  बिटकॉइन 50 प्रतिशत चढ़ गया !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":31}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"quM-IL2i12-B","executionInfo":{"status":"ok","timestamp":1620204868130,"user_tz":-300,"elapsed":2892727,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"1efc705b-2631-4038-a539-9342296987d0"},"source":["# Hindi for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('बिटकॉइन में 50 प्रतिशत की गिरावट !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[बिटकॉइन में 50 प्रतिशत की गिरावट !!!]</td>\n","      <td>0</td>\n","      <td>0.999983</td>\n","      <td>negative</td>\n","      <td>[-0.056788038462400436, -0.045364461839199066,...</td>\n","      <td>बिटकॉइन में 50 प्रतिशत की गिरावट !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                 sentence  ...                              document\n","0  [बिटकॉइन में 50 प्रतिशत की गिरावट !!!]  ...  बिटकॉइन में 50 प्रतिशत की गिरावट !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":32}]},{"cell_type":"markdown","metadata":{"id":"R4ByHOZn35Lc"},"source":["# The model understands Tartar\n","![tt](https://www.worldometers.info/img/flags/small/tn_rs-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"2JrzusSQ18F5","executionInfo":{"status":"ok","timestamp":1620204869238,"user_tz":-300,"elapsed":2893830,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"46084c37-33f9-47c2-e2da-46abf957bedf"},"source":["# Tartar for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict('Bitcoin 50 процентка төште !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin 50 процентка төште !!!]</td>\n","      <td>0</td>\n","      <td>0.99712</td>\n","      <td>negative</td>\n","      <td>[-0.046695344150066376, -0.045206207782030106,...</td>\n","      <td>Bitcoin 50 процентка төште !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                           sentence  ...                        document\n","0  [Bitcoin 50 процентка төште !!!]  ...  Bitcoin 50 процентка төште !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":33}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"J06Xm_Ln4AYu","executionInfo":{"status":"ok","timestamp":1620204870025,"user_tz":-300,"elapsed":2894612,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"32c93cbb-cf58-45ca-b911-594ec7639b25"},"source":["# Tartar for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict('Биткойн 50 процентка артты !!!')"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Биткойн 50 процентка артты !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.015944570302963257, -0.024691367521882057,...</td>\n","      <td>Биткойн 50 процентка артты !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                           sentence  ...                        document\n","0  [Биткойн 50 процентка артты !!!]  ...  Биткойн 50 процентка артты !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":34}]},{"cell_type":"markdown","metadata":{"id":"HKj5yWwwMplH"},"source":["# The Model understands French\n","![fr](https://www.worldometers.info/img/flags/small/tn_fr-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"CUHcJZfJMplL","executionInfo":{"status":"ok","timestamp":1620204870028,"user_tz":-300,"elapsed":2894605,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"f741335f-56eb-4083-9f74-a0f5c7ec177e"},"source":["# French for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin a chuté de 50% !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin a chuté de 50% !, !!]</td>\n","      <td>0</td>\n","      <td>0.999993</td>\n","      <td>negative</td>\n","      <td>[-0.05751340091228485, -0.055390965193510056, ...</td>\n","      <td>Bitcoin a chuté de 50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                         sentence  ...                    document\n","0  [Bitcoin a chuté de 50% !, !!]  ...  Bitcoin a chuté de 50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":35}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"57NY2XoTMplM","executionInfo":{"status":"ok","timestamp":1620204870622,"user_tz":-300,"elapsed":2895194,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"2f15d469-5c73-4b89-a8e6-164f8018e2a0"},"source":["# French for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Le Bitcoin a augmenté de 50% !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Le Bitcoin a augmenté de 50% !, !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.036176975816488266, -0.03910718113183975, ...</td>\n","      <td>Le Bitcoin a augmenté de 50% !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                               sentence  ...                          document\n","0  [Le Bitcoin a augmenté de 50% !, !!]  ...  Le Bitcoin a augmenté de 50% !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":36}]},{"cell_type":"markdown","metadata":{"id":"jD2TBgT0Nq6F"},"source":["# The Model understands Thai\n","![th](https://www.worldometers.info/img/flags/small/tn_th-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"gBp11S5GNq6S","executionInfo":{"status":"ok","timestamp":1620204871161,"user_tz":-300,"elapsed":2895726,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"0921469b-ddb9-4f90-84b8-2166499c38eb"},"source":["# Thai for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin เพิ่มขึ้น 50 เปอร์เซ็นต์ !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin เพิ่มขึ้น 50 เปอร์เซ็นต์ !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.0362008698284626, -0.02767593413591385, -0...</td>\n","      <td>Bitcoin เพิ่มขึ้น 50 เปอร์เซ็นต์ !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                 sentence  ...                              document\n","0  [Bitcoin เพิ่มขึ้น 50 เปอร์เซ็นต์ !!!]  ...  Bitcoin เพิ่มขึ้น 50 เปอร์เซ็นต์ !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":37}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Fxh1gasROElC","executionInfo":{"status":"ok","timestamp":1620204872032,"user_tz":-300,"elapsed":2896592,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"4861d19e-8dda-4bb1-b9c2-3fc73e6219bd"},"source":["# Thai  for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin ลดลง 50 เปอร์เซ็นต์ !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin ลดลง 50 เปอร์เซ็นต์ !!!]</td>\n","      <td>0</td>\n","      <td>0.99993</td>\n","      <td>negative</td>\n","      <td>[-0.05988080054521561, -0.04294697195291519, -...</td>\n","      <td>Bitcoin ลดลง 50 เปอร์เซ็นต์ !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                            sentence  ...                         document\n","0  [Bitcoin ลดลง 50 เปอร์เซ็นต์ !!!]  ...  Bitcoin ลดลง 50 เปอร์เซ็นต์ !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":38}]},{"cell_type":"markdown","metadata":{"id":"mLItI4KZOElB"},"source":["# The Model understands Khmer\n","![km](https://www.worldometers.info/img/flags/small/tn_cb-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"Mv0KkUxo7Lh_","executionInfo":{"status":"ok","timestamp":1620204872543,"user_tz":-300,"elapsed":2897098,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"928cecc5-9e0a-4438-ffb7-1f88cb6dd210"},"source":["# Khmer   for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin បានធ្លាក់ចុះ 50 ភាគរយ !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin បានធ្លាក់ចុះ 50 ភាគរយ !!!]</td>\n","      <td>0</td>\n","      <td>0.999976</td>\n","      <td>negative</td>\n","      <td>[-0.057029254734516144, -0.042525384575128555,...</td>\n","      <td>Bitcoin បានធ្លាក់ចុះ 50 ភាគរយ !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                              sentence  ...                           document\n","0  [Bitcoin បានធ្លាក់ចុះ 50 ភាគរយ !!!]  ...  Bitcoin បានធ្លាក់ចុះ 50 ភាគរយ !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":39}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SWbqMgAwOElC","executionInfo":{"status":"ok","timestamp":1620204873221,"user_tz":-300,"elapsed":2897769,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"1aa07a23-f0cd-40d9-a9b2-e34a32af3f4b"},"source":["# Khmer for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin បានកើនឡើង 50 ភាគរយ !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin បានកើនឡើង 50 ភាគរយ !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.0398690328001976, -0.03344428539276123, -0...</td>\n","      <td>Bitcoin បានកើនឡើង 50 ភាគរយ !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                           sentence  ...                        document\n","0  [Bitcoin បានកើនឡើង 50 ភាគរយ !!!]  ...  Bitcoin បានកើនឡើង 50 ភាគរយ !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":40}]},{"cell_type":"markdown","metadata":{"id":"lvE-LbNiPoBT"},"source":["# The Model understands Yiddish\n","![yi](https://www.worldometers.info/img/flags/small/tn_pl-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"sZlmLhajPoBb","executionInfo":{"status":"ok","timestamp":1620204873753,"user_tz":-300,"elapsed":2898296,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"b379f5c5-f85b-4fcf-8769-7d41c81135b8"},"source":["# Yiddish for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"ביטקאָין דראַפּט דורך 50 פּראָצענט !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[ביטקאָין דראַפּט דורך 50 פּראָצענט !!!]</td>\n","      <td>0</td>\n","      <td>0.999989</td>\n","      <td>negative</td>\n","      <td>[-0.05685275420546532, -0.04757662117481232, -...</td>\n","      <td>ביטקאָין דראַפּט דורך 50 פּראָצענט !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                   sentence  ...                                document\n","0  [ביטקאָין דראַפּט דורך 50 פּראָצענט !!!]  ...  ביטקאָין דראַפּט דורך 50 פּראָצענט !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":41}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"5h-pha_nPoBc","executionInfo":{"status":"ok","timestamp":1620204875147,"user_tz":-300,"elapsed":2899687,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"a8aad03f-19fa-430f-b1aa-4053990641af"},"source":["# Yiddish for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"ביטקאָין איז אַרויף מיט 50 פּראָצענט !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[ביטקאָין איז אַרויף מיט 50 פּראָצענט !!!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.04943440482020378, -0.05143021047115326, -...</td>\n","      <td>ביטקאָין איז אַרויף מיט 50 פּראָצענט !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                     sentence  ...                                  document\n","0  [ביטקאָין איז אַרויף מיט 50 פּראָצענט !!!]  ...  ביטקאָין איז אַרויף מיט 50 פּראָצענט !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":42}]},{"cell_type":"markdown","metadata":{"id":"XSz4WzScaAHj"},"source":["# The Model understands Kygrgyz\n","![ky](https://www.worldometers.info/img/flags/small/tn_kg-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"DXz6fhJSaAHu","executionInfo":{"status":"ok","timestamp":1620204875696,"user_tz":-300,"elapsed":2900229,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"7399213b-dac2-4025-945b-8d8ee778c266"},"source":["# Kygrgyz for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin 50 пайызга төмөндөдү !!! \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin 50 пайызга төмөндөдү !!!]</td>\n","      <td>0</td>\n","      <td>0.99996</td>\n","      <td>negative</td>\n","      <td>[-0.0606391467154026, -0.020774153992533684, -...</td>\n","      <td>Bitcoin 50 пайызга төмөндөдү !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                             sentence  ...                          document\n","0  [Bitcoin 50 пайызга төмөндөдү !!!]  ...  Bitcoin 50 пайызга төмөндөдү !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":43}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"lh_ZSHlPaAHv","executionInfo":{"status":"ok","timestamp":1620204876020,"user_tz":-300,"elapsed":2900548,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"7748fda1-aac9-47df-a24c-2248eb102336"},"source":["# Kygrgyz for : 'Bitcoin went up by 50 percent !!!'\n","fitted_pipe.predict(\"Bitcoin 50 пайызга көтөрүлдү !!!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[Bitcoin 50 пайызга көтөрүлдү !!!]</td>\n","      <td>0</td>\n","      <td>0.999998</td>\n","      <td>positive</td>\n","      <td>[-0.031883276998996735, -0.009198011830449104,...</td>\n","      <td>Bitcoin 50 пайызга көтөрүлдү !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                             sentence  ...                          document\n","0  [Bitcoin 50 пайызга көтөрүлдү !!!]  ...  Bitcoin 50 пайызга көтөрүлдү !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":44}]},{"cell_type":"markdown","metadata":{"id":"DGMVMKaTdJFj"},"source":["# The Model understands Tamil\n","![ta](https://www.worldometers.info/img/flags/small/tn_in-flag.gif)"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"JWDr_LoCdJFn","executionInfo":{"status":"ok","timestamp":1620204877114,"user_tz":-300,"elapsed":2901637,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"ffbaa262-cb4c-4ac8-a87b-dc8776100a5a"},"source":["# Tamil for : 'Bitcoin dropped by 50 percent !!!'\n","fitted_pipe.predict(\"பிட்காயின் 50 சதவீதம் குறைந்தது !!!  \")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[பிட்காயின் 50 சதவீதம் குறைந்தது !!!]</td>\n","      <td>0</td>\n","      <td>0.999997</td>\n","      <td>negative</td>\n","      <td>[-0.06173097714781761, -0.034972332417964935, ...</td>\n","      <td>பிட்காயின் 50 சதவீதம் குறைந்தது !!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                sentence  ...                             document\n","0  [பிட்காயின் 50 சதவீதம் குறைந்தது !!!]  ...  பிட்காயின் 50 சதவீதம் குறைந்தது !!!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":45}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"J8dGo9wLCFSa","executionInfo":{"status":"ok","timestamp":1620204877495,"user_tz":-300,"elapsed":2902012,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"09ecd623-1fb3-4f79-a784-feb110037c61"},"source":["# Tamil for : 'Dollar rates skyrocketed!!'\n","fitted_pipe.predict(\"ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!\")"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>trained_sentiment_confidence</th>\n","      <th>trained_sentiment</th>\n","      <th>sentence_embedding_labse</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!]</td>\n","      <td>0</td>\n","      <td>1.0</td>\n","      <td>positive</td>\n","      <td>[-0.06327779591083527, -0.029234550893306732, ...</td>\n","      <td>ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                sentence  ...                             document\n","0  [ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!]  ...  ڈالر کے نرخ آسمان چھائے ہوئے ہیں !!\n","\n","[1 rows x 6 columns]"]},"metadata":{"tags":[]},"execution_count":46}]},{"cell_type":"markdown","metadata":{"id":"2BB-NwZUoHSe"},"source":["# 5. Lets save the model"]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"eLex095goHwm","executionInfo":{"status":"ok","timestamp":1620205654008,"user_tz":-300,"elapsed":3678520,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"f76c419d-e144-44d7-a9c5-2dbc67b69d2c"},"source":["stored_model_path = './models/classifier_dl_trained' \n","fitted_pipe.save(stored_model_path)"],"execution_count":null,"outputs":[{"output_type":"stream","text":["Stored model in ./models/classifier_dl_trained\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"id":"e_b2DPd4rCiU"},"source":["# 6. Lets load the model from HDD.\n","This makes Offlien NLU usage possible!   \n","You need to call nlu.load(path=path_to_the_pipe) to load a model/pipeline from disk."]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/","height":80},"id":"SO4uz45MoRgp","executionInfo":{"status":"ok","timestamp":1620206095082,"user_tz":-300,"elapsed":136895,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"5f0bacad-9c51-4ca0-90d3-614260033d6e"},"source":["stored_model_path = './models/classifier_dl_trained' \n","\n","hdd_pipe = nlu.load(path=\"./models/classifier_dl_trained\")\n","\n","preds = hdd_pipe.predict('Bitcoin dropped by 50 percent!!')\n","preds"],"execution_count":null,"outputs":[{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>sentiment</th>\n","      <th>sentence</th>\n","      <th>origin_index</th>\n","      <th>sentiment_confidence</th>\n","      <th>text</th>\n","      <th>sentence_embedding_from_disk</th>\n","      <th>document</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>[negative, negative]</td>\n","      <td>[Bitcoin dropped by 50 percent!, !]</td>\n","      <td>8589934592</td>\n","      <td>[0.9999988, 0.9999988]</td>\n","      <td>Bitcoin dropped by 50 percent!!</td>\n","      <td>[[-0.049401186406612396, -0.02522580698132515,...</td>\n","      <td>Bitcoin dropped by 50 percent!!</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["              sentiment  ...                         document\n","0  [negative, negative]  ...  Bitcoin dropped by 50 percent!!\n","\n","[1 rows x 7 columns]"]},"metadata":{"tags":[]},"execution_count":1}]},{"cell_type":"code","metadata":{"colab":{"base_uri":"https://localhost:8080/"},"id":"e0CVlkk9v6Qi","executionInfo":{"status":"ok","timestamp":1620206095084,"user_tz":-300,"elapsed":136873,"user":{"displayName":"ahmed lone","photoUrl":"","userId":"02458088882398909889"}},"outputId":"e5d12349-cbe9-4f02-8266-490dd9ff9344"},"source":["hdd_pipe.print_info()"],"execution_count":null,"outputs":[{"output_type":"stream","text":["The following parameters are configurable for this NLU pipeline (You can copy paste the examples) :\n",">>> pipe['document_assembler'] has settable params:\n","pipe['document_assembler'].setCleanupMode('shrink')              | Info: possible values: disabled, inplace, inplace_full, shrink, shrink_full, each, each_full, delete_full | Currently set to : shrink\n",">>> pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'] has settable params:\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setExplodeSentences(False)  | Info: whether to explode each sentence into a different row, for better parallelization. Defaults to false. | Currently set to : False\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setStorageRef('SentenceDetectorDLModel_c83c27f46b97')  | Info: storage unique identifier | Currently set to : SentenceDetectorDLModel_c83c27f46b97\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setEncoder(com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@1b8112d8)  | Info: Data encoder | Currently set to : com.johnsnowlabs.nlp.annotators.sentence_detector_dl.SentenceDetectorDLEncoder@1b8112d8\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setImpossiblePenultimates(['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e'])  | Info: Impossible penultimates | Currently set to : ['Bros', 'No', 'al', 'vs', 'etc', 'Fig', 'Dr', 'Prof', 'PhD', 'MD', 'Co', 'Corp', 'Inc', 'bros', 'VS', 'Vs', 'ETC', 'fig', 'dr', 'prof', 'PHD', 'phd', 'md', 'co', 'corp', 'inc', 'Jan', 'Feb', 'Mar', 'Apr', 'Jul', 'Aug', 'Sep', 'Sept', 'Oct', 'Nov', 'Dec', 'St', 'st', 'AM', 'PM', 'am', 'pm', 'e.g', 'f.e', 'i.e']\n","pipe['sentence_detector@SentenceDetectorDLModel_c83c27f46b97'].setModelArchitecture('cnn')  | Info: Model architecture (CNN) | Currently set to : cnn\n",">>> pipe['bert_sentence@labse'] has settable params:\n","pipe['bert_sentence@labse'].setBatchSize(8)                      | Info: Size of every batch | Currently set to : 8\n","pipe['bert_sentence@labse'].setCaseSensitive(False)              | Info: whether to ignore case in tokens for embeddings matching | Currently set to : False\n","pipe['bert_sentence@labse'].setDimension(768)                    | Info: Number of embedding dimensions | Currently set to : 768\n","pipe['bert_sentence@labse'].setMaxSentenceLength(128)            | Info: Max sentence length to process | Currently set to : 128\n","pipe['bert_sentence@labse'].setIsLong(False)                     | Info: Use Long type instead of Int type for inputs buffer - Some Bert models require Long instead of Int. | Currently set to : False\n","pipe['bert_sentence@labse'].setStorageRef('labse')               | Info: unique reference name for identification | Currently set to : labse\n",">>> pipe['sentiment_dl@labse'] has settable params:\n","pipe['sentiment_dl@labse'].setThreshold(0.6)                     | Info: The minimum threshold for the final result otheriwse it will be neutral | Currently set to : 0.6\n","pipe['sentiment_dl@labse'].setThresholdLabel('neutral')          | Info: In case the score is less than threshold, what should be the label. Default is neutral. | Currently set to : neutral\n","pipe['sentiment_dl@labse'].setClasses(['positive', 'negative'])  | Info: get the tags used to trained this SentimentDLModel | Currently set to : ['positive', 'negative']\n","pipe['sentiment_dl@labse'].setStorageRef('labse')                | Info: unique reference name for identification | Currently set to : labse\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"dxr5nnv8zPLz"},"source":[""],"execution_count":null,"outputs":[]}]}